Modeling and predicting individual variation in COVID-19 vaccine-elicited antibody response in the general population.

As we learned during the COVID-19 pandemic, vaccines are one of the most important tools in infectious disease control. To date, an unprecedentedly large volume of high-quality data on COVID-19 vaccinations have been accumulated. For preparedness in future pandemics beyond COVID-19, these valuable datasets should be analyzed to best shape an effective vaccination strategy. We are collecting longitudinal data from a community-based cohort in Fukushima, Japan, that consists of 2,407 individuals who underwent serum sampling two or three times after a two-dose vaccination with either BNT162b2 or mRNA-1273. Using the individually reconstructed time courses of the vaccine-elicited antibody response based on mathematical modeling, we first identified basic demographic and health information that contributed to the main features of the antibody dynamics, i.e., the peak, the duration, and the area under the curve. We showed that these three features of antibody dynamics were partially explained by underlying medical conditions, adverse reactions to vaccinations, and medications, consistent with the findings of previous studies. We then applied to these factors a recently proposed computational method to optimally fit an "antibody score", which resulted in an integer-based score that can be used as a basis for identifying individuals with higher or lower antibody titers from basic demographic and health information. The score can be easily calculated by individuals themselves or by medical practitioners. Although the sensitivity of this score is currently not very high, in the future, as more data become available, it has the potential to identify vulnerable populations and encourage them to get booster vaccinations. Our mathematical model can be extended to any kind of vaccination and therefore can form a basis for policy decisions regarding the distribution of booster vaccines to strengthen immunity in future pandemics.

Exogenous and endogenous factors affecting stock market transactions: A Hawkes process analysis of the Tokyo Stock Exchange during the COVID-19 pandemic.

Transactions in financial markets are not evenly spaced but can be concentrated within a short period of time. In this study, we investigated the factors that determine the transaction frequency in financial markets. Specifically, we employed the Hawkes process model to identify exogenous and endogenous forces governing transactions of individual stocks in the Tokyo Stock Exchange during the COVID-19 pandemic. To enhance the accuracy of our analysis, we introduced a novel EM algorithm for the estimation of exogenous and endogenous factors that specifically addresses the interdependence of the values of these factors over time. We detected a substantial change in the transaction frequency in response to policy change announcements. Moreover, there is significant heterogeneity in the transaction frequency among individual stocks. We also found a tendency where stocks with high market capitalization tend to significantly respond to external news, while their excitation relationship between transactions is weak. This suggests the capability of quantifying the market state from the viewpoint of the exogenous and endogenous factors generating transactions for various stocks.

Impact of time-history terms on reservoir dynamics and prediction accuracy in echo state networks.

The echo state network (ESN) is an excellent machine learning model for processing time-series data. This model, utilising the response of a recurrent neural network, called a reservoir, to input signals, achieves high training efficiency. Introducing time-history terms into the neuron model of the reservoir is known to improve the time-series prediction performance of ESN, yet the reasons for this improvement have not been quantitatively explained in terms of reservoir dynamics characteristics. Therefore, we hypothesised that the performance enhancement brought about by time-history terms could be explained by delay capacity, a recently proposed metric for assessing the memory performance of reservoirs. To test this hypothesis, we conducted comparative experiments using ESN models with time-history terms, namely leaky integrator ESNs (LI-ESN) and chaotic echo state networks (ChESN). The results suggest that compared with ESNs without time-history terms, the reservoir dynamics of LI-ESN and ChESN can maintain diversity and stability while possessing higher delay capacity, leading to their superior performance. Explaining ESN performance through dynamical metrics are crucial for evaluating the numerous ESN architectures recently proposed from a general perspective and for the development of more sophisticated architectures, and this study contributes to such efforts.

Multiscale modeling of HBV infection integrating intra- and intercellular viral propagation to analyze extracellular viral markers.

Chronic infection with hepatitis B virus (HBV) is caused by the persistence of closed circular DNA (cccDNA) in the nucleus of infected hepatocytes. Despite available therapeutic anti-HBV agents, eliminating the cccDNA remains challenging. Thus, quantifying and understanding the dynamics of cccDNA are essential for developing effective treatment strategies and new drugs. However, such study requires repeated liver biopsy to measure the intrahepatic cccDNA, which is basically not accepted because liver biopsy is potentially morbid and not common during hepatitis B treatment. We here aimed to develop a noninvasive method for quantifying cccDNA in the liver using surrogate markers in peripheral blood. We constructed a multiscale mathematical model that explicitly incorporates both intracellular and intercellular HBV infection processes. The model, based on age-structured partial differential equations, integrates experimental data from in vitro and in vivo investigations. By applying this model, we roughly predicted the amount and dynamics of intrahepatic cccDNA within a certain range using specific viral markers in serum samples, including HBV DNA, HBsAg, HBeAg, and HBcrAg. Our study represents a significant step towards advancing the understanding of chronic HBV infection. The noninvasive quantification of cccDNA using our proposed method holds promise for improving clinical analyses and treatment strategies. By comprehensively describing the interactions of all components involved in HBV infection, our multiscale mathematical model provides a valuable framework for further research and the development of targeted interventions.

Anticipating regime shifts by mixing early warning signals from different nodes.

Real systems showing regime shifts, such as ecosystems, are often composed of many dynamical elements interacting on a network. Various early warning signals have been proposed for anticipating regime shifts from observed data. However, it is unclear how one should combine early warning signals from different nodes for better performance. Based on theory of stochastic differential equations, we propose a method to optimize the node set from which to construct an early warning signal. The proposed method takes into account that uncertainty as well as the magnitude of the signal affects its predictive performance, that a large magnitude or small uncertainty of the signal in one situation does not imply the signal's high performance, and that combining early warning signals from different nodes is often but not always beneficial. The method performs well particularly when different nodes are subjected to different amounts of dynamical noise and stress.

Sparse-firing regularization methods for spiking neural networks with time-to-first-spike coding.

The training of multilayer spiking neural networks (SNNs) using the error backpropagation algorithm has made significant progress in recent years. Among the various training schemes, the error backpropagation method that directly uses the firing time of neurons has attracted considerable attention because it can realize ideal temporal coding. This method uses time-to-first-spike (TTFS) coding, in which each neuron fires at most once, and this restriction on the number of firings enables information to be processed at a very low firing frequency. This low firing frequency increases the energy efficiency of information processing in SNNs. However, only an upper limit has been provided for TTFS-coded SNNs, and the information-processing capability of SNNs at lower firing frequencies has not been fully investigated. In this paper, we propose two spike-timing-based sparse-firing (SSR) regularization methods to further reduce the firing frequency of TTFS-coded SNNs. Both methods are characterized by the fact that they only require information about the firing timing and associated weights. The effects of these regularization methods were investigated on the MNIST, Fashion-MNIST, and CIFAR-10 datasets using multilayer perceptron networks and convolutional neural network structures.

Infectious virus shedding duration reflects secretory IgA antibody response latency after SARS-CoV-2 infection.

Infectious virus shedding from individuals infected with severe acute respiratory syndrome-coronavirus 2 (SARS-CoV-2) is used to estimate human-to-human transmission risk. Control of SARS-CoV-2 transmission requires identifying the immune correlates that protect infectious virus shedding. Mucosal immunity prevents infection by SARS-CoV-2, which replicates in the respiratory epithelium and spreads rapidly to other hosts. However, whether mucosal immunity prevents the shedding of the infectious virus in SARS-CoV-2-infected individuals is unknown. We examined the relationship between viral RNA shedding dynamics, duration of infectious virus shedding, and mucosal antibody responses during SARS-CoV-2 infection. Anti-spike secretory IgA antibodies (S-IgA) reduced viral RNA load and infectivity more than anti-spike IgG/IgA antibodies in infected nasopharyngeal samples. Compared with the IgG/IgA response, the anti-spike S-IgA post-infection responses affected the viral RNA shedding dynamics and predicted the duration of infectious virus shedding regardless of the immune history. These findings highlight the importance of anti-spike S-IgA responses in individuals infected with SARS-CoV-2 for preventing infectious virus shedding and SARS-CoV-2 transmission. Developing medical countermeasures to shorten S-IgA response time may help control human-to-human transmission of SARS-CoV-2 infection and prevent future respiratory virus pandemics.

Isolation may select for earlier and higher peak viral load but shorter duration in SARS-CoV-2 evolution.

During the COVID-19 pandemic, human behavior change as a result of nonpharmaceutical interventions such as isolation may have induced directional selection for viral evolution. By combining previously published empirical clinical data analysis and multi-level mathematical modeling, we find that the SARS-CoV-2 variants selected for as the virus evolved from the pre-Alpha to the Delta variant had earlier and higher peak in viral load dynamics but a shorter duration of infection. Selection for increased transmissibility shapes the viral load dynamics, and the isolation measure is likely to be a driver of these evolutionary transitions. In addition, we show that a decreased incubation period and an increased proportion of asymptomatic infection are also positively selected for as SARS-CoV-2 mutated to adapt to human behavior (i.e., Omicron variants). The quantitative information and predictions we present here can guide future responses in the potential arms race between pandemic interventions and viral evolution.

STAMarker: determining spatial domain-specific variable genes with saliency maps in deep learning.

Spatial transcriptomics characterizes gene expression profiles while retaining the information of the spatial context, providing an unprecedented opportunity to understand cellular systems. One of the essential tasks in such data analysis is to determine spatially variable genes (SVGs), which demonstrate spatial expression patterns. Existing methods only consider genes individually and fail to model the inter-dependence of genes. To this end, we present an analytic tool STAMarker for robustly determining spatial domain-specific SVGs with saliency maps in deep learning. STAMarker is a three-stage ensemble framework consisting of graph-attention autoencoders, multilayer perceptron (MLP) classifiers, and saliency map computation by the backpropagated gradient. We illustrate the effectiveness of STAMarker and compare it with serveral commonly used competing methods on various spatial transcriptomic data generated by different platforms. STAMarker considers all genes at once and is more robust when the dataset is very sparse. STAMarker could identify spatial domain-specific SVGs for characterizing spatial domains and enable in-depth analysis of the region of interest in the tissue section.

Earthquake alerting based on spatial geodetic data by spatiotemporal information transformation learning.

Alerting for imminent earthquakes is particularly challenging due to the high nonlinearity and nonstationarity of geodynamical phenomena. In this study, based on spatiotemporal information (STI) transformation for high-dimensional real-time data, we developed a model-free framework, i.e., real-time spatiotemporal information transformation learning (RSIT), for extending the nonlinear and nonstationary time series. Specifically, by transforming high-dimensional information of the global navigation satellite system into one-dimensional dynamics via the STI strategy, RSIT efficiently utilizes two criteria of the transformed one-dimensional dynamics, i.e., unpredictability and instability. Such two criteria contemporaneously signal a potential critical transition of the geodynamical system, thereby providing early-warning signals of possible upcoming earthquakes. RSIT explores both the spatial and temporal dynamics of real-world data on the basis of a solid theoretical background in nonlinear dynamics and delay-embedding theory. The effectiveness of RSIT was demonstrated on geodynamical data of recent earthquakes from a number of regions across at least 4 y and through further comparison with existing methods.

Contrastively generative self-expression model for single-cell and spatial multimodal data.

Advances in single-cell multi-omics technology provide an unprecedented opportunity to fully understand cellular heterogeneity. However, integrating omics data from multiple modalities is challenging due to the individual characteristics of each measurement. Here, to solve such a problem, we propose a contrastive and generative deep self-expression model, called single-cell multimodal self-expressive integration (scMSI), which integrates the heterogeneous multimodal data into a unified manifold space. Specifically, scMSI first learns each omics-specific latent representation and self-expression relationship to consider the characteristics of different omics data by deep self-expressive generative model. Then, scMSI combines these omics-specific self-expression relations through contrastive learning. In such a way, scMSI provides a paradigm to integrate multiple omics data even with weak relation, which effectively achieves the representation learning and data integration into a unified framework. We demonstrate that scMSI provides a cohesive solution for a variety of analysis tasks, such as integration analysis, data denoising, batch correction and spatial domain detection. We have applied scMSI on various single-cell and spatial multimodal datasets to validate its high effectiveness and robustness in diverse data types and application scenarios.

Maximal Memory Capacity Near the Edge of Chaos in Balanced Cortical E-I Networks.

We examine the efficiency of information processing in a balanced excitatory and inhibitory (E-I) network during the developmental critical period, when network plasticity is heightened. A multimodule network composed of E-I neurons was defined, and its dynamics were examined by regulating the balance between their activities. When adjusting E-I activity, both transitive chaotic synchronization with a high Lyapunov dimension and conventional chaos with a low Lyapunov dimension were found. In between, the edge of high-dimensional chaos was observed. To quantify the efficiency of information processing, we applied a short-term memory task in reservoir computing to the dynamics of our network. We found that memory capacity was maximized when optimal E-I balance was realized, underscoring both its vital role and vulnerability during critical periods of brain development.

Multiscale modeling of HBV infection integrating intra- and intercellular viral propagation for analyzing extracellular viral markers.

Chronic infection of hepatitis B virus (HBV) is caused by the persistence of closed circular DNA (cccDNA) in the nucleus of infected hepatocytes. Despite available therapeutic anti-HBV agents, eliminating the cccDNA remains challenging. The quantifying and understanding dynamics of cccDNA are essential for developing effective treatment strategies and new drugs. However, it requires a liver biopsy to measure the intrahepatic cccDNA, which is basically not accepted because of the ethical aspect. We here aimed to develop a non-invasive method for quantifying cccDNA in the liver using surrogate markers present in peripheral blood. We constructed a multiscale mathematical model that explicitly incorporates both intracellular and intercellular HBV infection processes. The model, based on age-structured partial differential equations (PDEs), integrates experimental data from in vitro and in vivo investigations. By applying this model, we successfully predicted the amount and dynamics of intrahepatic cccDNA using specific viral markers in serum samples, including HBV DNA, HBsAg, HBeAg, and HBcrAg. Our study represents a significant step towards advancing the understanding of chronic HBV infection. The non-invasive quantification of cccDNA using our proposed methodology holds promise for improving clinical analyses and treatment strategies. By comprehensively describing the interactions of all components involved in HBV infection, our multiscale mathematical model provides a valuable framework for further research and the development of targeted interventions.

A Supervised Learning Algorithm for Multilayer Spiking Neural Networks Based on Temporal Coding Toward Energy-Efficient VLSI Processor Design.

Spiking neural networks (SNNs) are brain-inspired mathematical models with the ability to process information in the form of spikes. SNNs are expected to provide not only new machine-learning algorithms but also energy-efficient computational models when implemented in very-large-scale integration (VLSI) circuits. In this article, we propose a novel supervised learning algorithm for SNNs based on temporal coding. A spiking neuron in this algorithm is designed to facilitate analog VLSI implementations with analog resistive memory, by which ultrahigh energy efficiency can be achieved. We also propose several techniques to improve the performance on recognition tasks and show that the classification accuracy of the proposed algorithm is as high as that of the state-of-the-art temporal coding SNN algorithms on the MNIST and Fashion-MNIST datasets. Finally, we discuss the robustness of the proposed SNNs against variations that arise from the device manufacturing process and are unavoidable in analog VLSI implementation. We also propose a technique to suppress the effects of variations in the manufacturing process on the recognition performance.

Early dynamics of chronic myeloid leukemia on nilotinib predicts deep molecular response.

Chronic myeloid leukemia (CML) is a myeloproliferative disorder caused by the BCR-ABL1 tyrosine kinase. Although ABL1-specific tyrosine kinase inhibitors (TKIs) including nilotinib have dramatically improved the prognosis of patients with CML, the TKI efficacy depends on the individual patient. In this work, we found that the patients with different nilotinib responses can be classified by using the estimated parameters of our simple dynamical model with two common laboratory findings. Furthermore, our proposed method identified patients who failed to achieve a treatment goal with high fidelity according to the data collected only at three initial time points during nilotinib therapy. Since our model relies on the general properties of TKI response, our framework would be applicable to CML patients who receive frontline nilotinib or other TKIs.

Energy landscape decomposition for cell differentiation with proliferation effect.

Complex interactions between genes determine the development and differentiation of cells. We establish a landscape theory for cell differentiation with proliferation effect, in which the developmental process is modeled as a stochastic dynamical system with a birth-death term. We find that two different energy landscapes, denoted U and V, collectively contribute to the establishment of non-equilibrium steady differentiation. The potential U is known as the energy landscape leading to the steady distribution, whose metastable states stand for cell types, while V indicates the differentiation direction from pluripotent to differentiated cells. This interpretation of cell differentiation is different from the previous landscape theory without the proliferation effect. We propose feasible numerical methods and a mean-field approximation for constructing landscapes U and V. Successful applications to typical biological models demonstrate the energy landscape decomposition's validity and reveal biological insights into the considered processes.

Designing isolation guidelines for COVID-19 patients with rapid antigen tests.

Appropriate isolation guidelines for COVID-19 patients are warranted. Currently, isolating for fixed time is adopted in most countries. However, given the variability in viral dynamics between patients, some patients may no longer be infectious by the end of isolation, whereas others may still be infectious. Utilizing viral test results to determine isolation length would minimize both the risk of prematurely ending isolation of infectious patients and the unnecessary individual burden of redundant isolation of noninfectious patients. In this study, we develop a data-driven computational framework to compute the population-level risk and the burden of different isolation guidelines with rapid antigen tests (i.e., lateral flow tests). Here, we show that when the detection limit is higher than the infectiousness threshold values, additional consecutive negative results are needed to ascertain infectiousness status. Further, rapid antigen tests should be designed to have lower detection limits than infectiousness threshold values to minimize the length of prolonged isolation.

Estimation of timing of infection from longitudinal SARS-CoV-2 viral load data: mathematical modelling study.

BACKGROUND: Multiple waves of the COVID-19 epidemic have hit most countries by the end of 2021. Most of those waves are caused by emergence and importation of new variants. To prevent importation of new variants, combination of border control and contact tracing is essential. However, the timing of infection inferred by interview is influenced by recall bias and hinders the contact tracing process. METHODS: We propose a novel approach to infer the timing of infection, by employing a within-host model to capture viral load dynamics after the onset of symptoms. We applied this approach to ascertain secondary transmission which can trigger outbreaks. As a demonstration, the 12 initial reported cases in Singapore, which were considered as imported because of their recent travel history to Wuhan, were analyzed to assess whether they are truly imported. RESULTS: Our approach suggested that 6 cases were infected prior to the arrival in Singapore, whereas other 6 cases might have been secondary local infection. Three among the 6 potential secondary transmission cases revealed that they had contact history to previously confirmed cases. CONCLUSIONS: Contact trace combined with our approach using viral load data could be the key to mitigate the risk of importation of new variants by identifying cases as early as possible and inferring the timing of infection with high accuracy.

Monkey Prefrontal Single-Unit Activity Reflecting Category-Based Logical Thinking Process and Its Neural Network Model.

Category-based thinking is a fundamental form of logical thinking. Here, we aimed to investigate its neural process at the local circuit level in the prefrontal cortex (PFC). We recorded single-unit PFC activity while male monkeys (Macaca fuscata) performed a task in which the category and rule were prerequisites of logical thinking and the outcome contingency was its consequence. Different groups of neurons coded a single type of information discretely or multiple types in a transitional form. Results of time-by-time analysis of neuronal activity suggest an information flow from category-coding and rule-coding neurons to transitional intermediate neurons, and then to contingency-coding neurons. Category-coding, rule-coding, and contingency-coding neurons showed stable coding of information, whereas intermediate neurons showed dynamic coding, as if it integrated category and rule to derive contingency. A similar process was confirmed by using a spiking neural network model that consisted of subnetworks coding category and rule on the input layer and those coding contingency on the output layer, with a subnetwork for integration in the intermediate layer. These results suggest that category-based logical thinking is realized in the PFC by separated neural populations organized for working in a feedforward manner.SIGNIFICANCE STATEMENT To elucidate the neural process for logical thinking, we combined an in-depth analysis of single-unit activity data with a biologically plausible computational model. Results of time-by-time analysis of prefrontal neuronal activity suggest an information flow from category-coding and rule-coding neurons to transitional intermediate neurons, and then to contingency-coding neurons. Category-coding, rule-coding, and contingency-coding neurons showed stable coding, whereas intermediate neurons showed dynamic coding, as if they integrated category and rule to derive contingency. A spiking neural network model reproduced similar temporal changes of information as the recorded neuronal data. Our results suggest that the prefrontal cortex (PFC) is critically involved in category-based thought process, and this process may be produced by separated neural populations organized for working in a feedforward manner.